Add compression to SBN atmospheric product generation#4649
Open
ChristopherHill-NOAA wants to merge 7 commits intoNOAA-EMC:dev/gfs.v17from
Open
Add compression to SBN atmospheric product generation#4649ChristopherHill-NOAA wants to merge 7 commits intoNOAA-EMC:dev/gfs.v17from
ChristopherHill-NOAA wants to merge 7 commits intoNOAA-EMC:dev/gfs.v17from
Conversation
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
NCO requires that the total volume of post-processing products to be transmitted through the SBN not exceed current operational levels. The generation of these products in retrospective runs of GFSv17 have marginally exceeded operational levels, and the files must be reduced in size (in lieu of the outright removal of some).
This PR simply adds a compression/packing attribute to the generation of WMO-headed atmospheric products within the script exgfs_atmos_awips_20km_1p0deg.sh, accomplished by revising the
-set_grib_typeoption of WGRIB2 from "same" to "complex2".This PR is intended to resolve #4614.
Type of change
Change characteristics
How has this been tested?
The GFS workflow was cloned and built on WCOSS. A CI test only confirmed nominal functionality with the code change, as the products resulting from the low resolution run were too small for the code change to produce the necessary effect.
Offline tests executing a segment of
exgfs_atmos_awips_20km_1p0deg.shwith files fromproducts/atmos/grib2/0p25as input resulted in a reduction to the size of the products.It is recommended that the changes from this PR be tested in a single cycle, high-resolution test of GFSv17, to confirm its intended effect to reduce SBN product volume to the extent required by NCO.
Checklist